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A PREDICTION INTERVAL FOR A FIRST 



ORDER GAUSSIAN MARKOV PROCESS 
by 

Toke Jayachandran and T.S. Mur thy 



Let x t (t 3 1,2,...) be a stationary Gaussian Markov process of order one 

2 ]£ 

with E ( x t ) - y and Cov ( X t ,X t+k^ = 0 P • We derive a prediction interval for 



x n based on the preceding 2n observations x-x„,...,x 0 . 
zn+1 1 l in 



1 . INTRODUCTION 

Consider a stationary Gaussian Markov process of order one with E(x^) = y 
2 k 

and CovCx^ , = o p . For y = 0 such a process can be generated from an 
autoregressive model 



x = px - + e t « 1,2,... (1.1) 

t t-1 t 

with {e^} a sequence of independent and identically distributed random variables 

with normal distributions N(0,a ), | p { <1 and x^ = 0. The process has many 

applications such as in modelling certain economic and meteorological time 

series. From a set of sample observations x 9 x 9 . . . 9 x 9 in this paper, we 

construct a conditional prediction interval for x 9 ^ + ^ treat i- n S one half of 

the observations as conditioning variables. The effect of the parameters 
2 

a ,p,k and the prediction coefficient a on the prediction interval is also 
investigated . 



2. DERIVATION OF PREDICTION INTERVAL 
For the stochastic process defined above it can be shown [1] that when 
X 2k-1* k ~ l>2,...,n+l are fixed, x 2 ^> k = l,2,...,n are conditionally inde- 
pendent and are normally distributed with mean y 9 ^ = a + bx r ^ and variance 



1 



( 2 . 1 ) 



a ~ where 
o 

a = m(l - p)^/(l + p^) 
b - 2p/(l + p 2 ) 

x 'k ‘ (x 2k-l + x 2k+l )/2 

a = cr (1 - p z )/(l + p z ) . 
o 

Conditionally, it may therefore be assumed that the x satisfy the simple 

Z K 

linear regression model 



= a + bx\ + 



2k 



k + % 



k = 1 , 2 , . . . ,n 



where (e } are i*i*d N(0,cr ). 
k o 

Given the sample observations x_,x-,...,x_ ,x_ (1 , from standard regression 

1 l zn zn+i 

2 

theory the parameters a,b and in (2.1) can be estimated using the first 

2n-l observations as 



b = $ Is 

xy xx 

a = x 2 - bx T 



( 2 . 2 ) 



where 



a 2 = (s - b 2 s ) / (n-3) 
o yy xx 



n~l 

E x' / (n-l)= (x + 2x 
k=l * 1 J 



2X5 . . .+ 2* 2n _ 3 + x^)/' 



x 2 ' 



n-1 

E x / (n-1) 
k=l 



XX 



n 1 2 _ ? 

Ex/- (n-l)x'“ 
k=l k 



2 



n 1 2 — 2 

5 yy ■ ^ *2k - 

n-1 



S xy ' f X 'k X 2k ‘ <"-1> k ' x 2 ' 



If x„ is the least squares predictor of x„ i.e., x„ = a + bx' then 
2n 2n 2n n 



X 2n " X 2n 



, (x’ - x’) 

i +-i- + — S 

n-1 s 



r \ 2 



XX 



has a student T s t-distribution with n-3 degrees of freedom; hence 



( 

{ | x„ - x_ 1 < t a 


1 (x’ - x') 2 ‘ 

1 + -i-+ n 


H ) 


) 1 2n 2n 1 o 


n-1 s 




( 


L xx J 





= 1 - a 



where t is the 100(1 - ^th percentage point of the studentfs t-distribution 
with n-3 degrees of freedom. The above probability statement can be converted 

A 

into a prediction interval for x 2 n +i> by noting that x ^ is a function of 

x T = (x 0 - + x- , ^ ) / 2 » as shown below, 

n Zn-1 Zn+1 

Squaring the inequality and rearranging terms the above probability 
statement can be expressed as 



/ t 2 2v 

[b 2 - — ] (x 1 - x T ) 2 - 2b (x - x )(x’ - x f ) 

l s / n Zn Z n 

\ XX / 



2 2 

_ ? nt a 

+ ix 2n ' x 2> - * 0 



= 1 - a 



(2.3) 



or 



[ a(x '„ - 



x’) 2 + B(x’ - x’) + C < 
n 






1 - a 



(2.4) 
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where 



A = 
B = 
C = 



2 " 2 

>v 0 to 

b 2 2- 

s 

XX 



- 2b(x 2n " X 2 } 

2" 2 

0 nt a 

/ \ 2 o 

(x 2n - x 2> - 



(2 



A prediction "interval" for x f = (x. - + x_ ,,)/2 and in turn for 

n 2n-l 2n+l 

X 2n+1 n ° W 0 ^ ta ^ na ^^ e terms °f the roots of the quadratic expression 
2 

in (2.4). If B - 4AC<0 i.e., the roots are complex the prediction interval 
will be taken to be (- 00 , 00 ); in the other cases the "interval" can turn out to 
be a two sided interval, a one sided interval or the union of two one sided 
intervals* The different possibilities will now be examined in detail. 



3. PROPERTIES OF THE PREDICTION INTERVAL 



Case 1: A > 0 



Let 



b 2 s 



F = 



xx 



2" 2 
t a 

o 



Then, A > 0 4 F > 1 . 



Also, B - 4AC>0 £=> 



F > 1 - 



(n-l) (x 2n - x 2 ) 2 

2" 2 
nt a 

o 



Hence, A>0 =>B - 4AC>0 and the prediction interval for x^ , „ will be 

2n+l 

of the form (D-E, D+E) where 



D - 2x' - x + 2b(x - x )/(b 2 - t 2 a 2 /s ) 

2n-l 2n 2 o xx 



E = 2ta 



, - ,2 / 2 " 2 

(x - x ) / t a 

L_ + _S_ b 2 _ 2_ 

s____ n-l \ s 



XX 



XX 




(3 
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Case 2 : A < 0, B“ - 4AC>0 

A < 0 and B“ - 4AC>0^ = ) 

n i < x 9t , ~ x 9 ) 2 

1 - Bzi l < p < 

1 n 2 " 2 * 

t a 



1 



and the prediction interval will be the union of two non-overlapping intervals 

(- °°, D+E) and (D-E, 00 ). Note that in this case E < 0. 

2 

Case 3 : A ^ 0, B - 4AC<0 

As indicated earlier, the roots will be complex and the prediction 

interval is defined to be (-<»<»). We will call the prediction intervals 

resulting from the above three cases a type 1, type 2 and a type 3 interval, 

2 

respectively. There are two other cases viz., A = 0 and B - 4AC = 0 and 
we have ignored these possibilities since their probability of occurrence 
is zero. It should be clear that the following identity holds for the pre- 
diction coefficient 1 - a. 

3 

I P[an interval of type i is obtained]. P[the interval will contain 
i=l 



To study the effect of the parameters n,p,a and a on the probability of 
occurrence of the different types of intervals we conducted a simulation. For 
each choice of the parameter values, 2n+l samples are generated from the auto- 
regressive process (1.1) and the prediction interval for x. is calculated 

zn+1 

using the first 2n values. We then calculated the empirical frequencies of 
the three types of intervals, in 1000 replications, and also for each type of 
interval the frequency of inclusion of x 2 n +]/ Table 1 we present the 
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results for a = .05, a = 1.0, n - 14,22,30,38 as p takes on the values 
.1, .3, .5, .7, .9. Table 2 shows the effect of increasing n as the other 
parameters are held fixed. In Table 3 the standard deviation a is varied 
from 1 to 5 while the other parameter values are fixed. Some of the results 
are also presented in graphical form in figures 1-5. 

The following general conclusions can be drawn from the results of the 
simulation. The probability of obtaining a type 1 interval increases with 
p, n and a. For n > 15 (30 or more samples) and p > .5 the probability of 
a type 1 interval is of the order of .85. The standard deviation a does 
not appear to have any effect on this probability. 



4 . AN EXAMPLE 



The following data represents the monthly Dow-Jones industrial averages 



for the years 


1966 


-67. 










1966 




1967 


Jan 


31 


983.51 


Jan 


31 


879.87 


Feb 


28 


951.89 


Feb 


28 


839.37 


Mar 


31 


924.77 


Mar 


31 


865.98 


Apr 


30 


933.68 


Apr 


28 


897.05 


May 


31 


884.07 


May 


31 


852.56 


Jun 


30 


870.10 


Jun 


30 


860.26 


Jul 


29 


847.38 


Jul 


31 


904.24 


Aug 


31 


788.41 


Aug 


31 


901.29 


Sep 


30 


774.22 


Sep 


29 


926.66 


Oct 


31 


807.07 


Oct 


31 


879.74 


Nov 


30 


791.59 


Nov 


30 


875.81 


Dec 


30 


785.69 


Dec 


29 


905.11 


Assuming that 


the 


data is generated by 


a Gaussian Markov 


process i 



(a calculation of lagged correlations supports the assumption with p = .8) we 
computed prediction intervals for March 1967, May 1967, July 1967, September 
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1967 and November 1967 based on all the preceding data and the results are 



presented below. 







Lower 


Upper 


Length 


True 


Month 


n 


Prediction 


Prediction 


of 


Value 






Limit 


Limit 


Interval 




Mar 67 


7 


727.11 


1080.63 


353.52 


865.98 


May 67 


8 


598.39 


900.56 


302.16 


852.56 


Jul 67 


9 


708.70 


1009.10 


300.40 


904.24 


Sep 67 


10 


573.59 ' 


864.87 


291.28 


926.66 


Nov 67 


11 


633.12 


899.73 


266.61 


875.81 




All the 


intervals except for September 


1967 contain the 


true 




value. 


As is to be 


expected the length of the interval 


decreases 




with an 


increase in 


sample size. 
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PROBABILITIES OF OCCURRENCE OF PREDICTION INTERVALS 
OF TYPES 1,2,3 IN 1000 REPLICATIONS 

TABLE I 



a = 1 



a = .05 













Empirical 


n 


P 


P (type 1) 


P (type 2) 


P (type 3) 


Prediction 

Coefficient 




.1 


.193 


.066 


.741 


.956 






(.917) 


(.576) 








.3 


.342 


.080 


.578 


.953 






(.915) 


(.775) 








.5 


.269 


.098 


.633 


.949 


7 




(.888) 


(.786) 








.7 


.369 


.119 


.512 


.949 






(.902) 


(.874) 








.9 


.539 


.128 


.333 


.958 






(.939) 


(.930) 








.1 


.492 


.048 


.460 


.941 






(.935) 


(.438) 








.3 


.516 


.077 


.407 


.939 






(.924) 


(.714) 






ii 


.5 


.483 


.110 


.407 


.936 




(.909) 


(.818) 








.7 


.791 


.071 


.138 


.939 






(.934) 


(.873) 








.9 


.902 


.050 


.048 


.948 






(.947) 


(.920) 
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Table I (Continued) 













Empirical 


n 


P 


P(type 1) 


P (type 2) 


P (type 3) 


Prediction 

Coefficient 




.1 


.554 


.036 


.410 


.968 






(.960) 


(.722) 








.3 


.861 


.033 


.106 


.940 






(.940) 


(.758) 






15 


.5 


.874 


.044 


.082 


.951 




(.952) 


(.841) 








.7 


.914 


.028 


.058 


.953 






(.951) 


(.929) 








.9 


.979 


.008 


.013 


.953 






(.952) 


(1.000) 








.1 


.573 


.047 


.380 


.948 






(.932) 


(.723) 








.3 


.719 


.044 


.237 


.952 






(.947) 


(.773) 






21 


.5 


.853 


.047 


.100 


.946 




(.943) 


(.894) 








.7 


.980 


.007 


.013 


.948 






(.948) 


(.857) 








.9 


.998 


.001 


.001 


.947 






(.947) 


(1.000) 







The numbers in parentheses are the probabilities that x 2 n +l 
is contained in the interval; for a type 3 interval this prob- 
ability is always 1. 
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PROBABILITIES OF OCCURRENCE OF PREDICTION INTERVALS 







OF TYPES 
a = 1 


1,2,3 IN 1000 
TABLE II 


REPLICATIONS 
a = .05 














Empirical 


p 


n 


P (type 1) 


P (type 2) 


P (type 3) 


Prediction 

Coefficient 




3 


.300 

(.867) 


.040 

(.600) 


. 660 


.944 




4 


.342 

(.915) 


.080 

(.775) 


.578 


.953 




5 


.587 

(.942) 


.057 

(.737) 


.356 


.951 


.3 




6 


.516 

(.924) 


.077 

(.714) 


.407 


.939 




7 


.259 

(.946) 


.106 

(.698) 


.635 


.954' 




8 


.861 

(.940) 


.033 

(.758) 


.106 


.940 




3 


.232 

(.853) 


.049 

(.694) 


.719 


.951 




4 


.269 

(.888) 


.098 

(.786) 


.633 


.949 




5 


.540 

(.935) 


.083 

(.819) 


.377 


.950 


.5 




6 


.483 

(.909) 


.110 

(.818) 


.407 


.936 




7 


.561 

(.941) 


.109 

(.853) 


.330 


.951 




8 


.874 

(.952) 


.044 

(.841) 


.082 


.951 
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Table II (Continued) 



Empirical 



n 


P (type 1) 


P (type 2) 


P (type 3) 


Prediction 

Coefficient 


3 


.308 


.072 


.620 


.958 




(.896) 


(.861) 






4 


.369 


.119 


.512 


.949 




(.902) 


(.874) 






5 


.586 


.095 


.319 


.942 




(.920) 


(.884) 






6 


.791 


.071 


.138 


.939 




(.934) 


(.873) 






7 


.840 


.065 


.095 


.944 




(.940) 


(.90 8) 






8 


.914 


.028 


.058 


.953 




(.951) 


(.929) 
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PROBABILITIES OF OCCURRENCE OF PREDICTION INTERVALS 
OF TYPES 1,2,3 IN 1000 REPLICATIONS 

TABLE III 

a = .05 













Empirical 




a 


P(type 1) • 


P (type 2) 


P(type 3) 


Prediction 

Coefficient 




i 


.369 


.119 


.512 


.949 






(.902) 


(.874) 






n=8 


2 


.352 


.123 


.525 


.951 


P = .7 




(.901) 


(.886) 








3 


.354 


.122 


.524 


.950 






(.898) 


(.885) 








4 


.354 


.121 


.525 


.950 






(.898) 


(.884) 








5 


.353 


.122 


.525 


.950 






(.898) 


(.885) 








1 


.483 


.110 


.407 


.936 


n=12 




(.909) 


(.818) 






P-.5 


2 


.446 

(.901) 


.115 

(.826) 


.439 


.936 




3 


.445 


.117 


.438 


.935 






(.899) 


(.828) 








4 


.446 


.115 


.439 


.935 






(.899) 


(.826) 








5 


.444 


.115 


.441 


.935 






(.901) 


(.817) 
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PROB. OF TYPES OF INT 



Fig. 1. n versus P(Intervals of types 1,2,3) 



p = .5 a = 3.0 a = .05 




n 



PROB. OF TYPES OF INT 



Fig. 2. n versus P(Intervals of types 1,2,3) 
p = . 7 a=l. 0 a = .05 
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PROB. OF TYPES OF INT. 



3. p versus P(Intervals of 



types 1,2,3) 
.05 



n = 5 a = 3 




P -> 
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PROB. OF TYPES OF INT. 



Fig. 4. p versus P(Intervals of types 1,2,3) 



n = 15 a = 1.0 a = .05 




P -► 
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PROB. OF TYPE 1 INT. 



Fig. 



a = 



5. n versus P(type 1 interval) 
•02, .05, .10 p = .9 p = 1.0 




17 



APPENDIX 



C PROGRAM TG CALCULATE PROBABILITY CF TYPE 1, t YPE 2 , type 

C 3 , T Y D E 4 IN’ERVALS F p R SIMULATED SAMPLES. 

C PROGRAMMER T S MUR THY SEP 1979. 

C *JU <JU JU «JLr OU -JU vU <*4# vU <JU -JU -JU X* «JU <JU ^ ^ X* X* X* w -J* >v sU Xr -*V vU <JU nW *1* «JU J# <JU vl# -X X X <Jl X X X X X X X X 

-r* *5* -v* a* *v* -r^r* # i^ -v* +r » n' -r* ^ -v* -r* *r» ^ -«* -v* ■'•or -y* -^p ^ v -r* T *P y y t y ^ xr* ^r X 5 

CI MENS ION Z(55)»X(55)»V(100»55),XI(50) , Y I ( 50 ) , S ( 5 5 ) , 
1IC( 5) , IRC 5), I°C( 5 ) , STA T ( 10, 7) ,VS{ 1C, 10, 7) , I VS ( 1 0) 

CALL OVF LOW 
INDEX =1 
SIGMA = 1 .0 

1 REA0(5,2) K,T 

WRI’E ( 6 ,2 ) K , T 
2 FOR ^AT{ IX, 12, 2X =F 5. 3) 

I F { K .EQ. 0 ) GO TO 460 
ROW =0.10 
00 300 IB =1, 5 
00 10 J=1 , 5 
3 = < 1 - ROW* *2 )**.5 

C S I MU L AT ION OF SAM PL ES 

I SEED= 12345 
10 I PC t J ) =0 

CG 250 I A=l, 10 

00 5 C M = l f 100 

CALL SNORM(ISEED,Z,K) 

X(l) =RIGMA*Z(1> 

CO 30 J = 2,K 

30 X( J }=RGW*X( J- l)<-3 *S IGMA*Z( J) 

00 40 L =1 , K 
4 0 V ( M » L ) =X ( L ) 

50 CONTINUE 

00 60 I I =1,5 
6 0 I R ( 1 1) =0 

CG 200 1=1, IOC 
OG 70 J = 1 , K 
70 S I J ) =V ( 1 , J ) 

K= K-5 
KK=K/2 
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80 



03 SC L=1 » KK 
Y I ( l ) =8 ( 2 * LJ 
N=KK-l 

03 SO LL= It N 
90 XI ( Ll)=< S12*LL-1) + S(2*LL+1J )/2 .0 
XSUY=0.0 
YSUM=0.0 
SX X=C. 0 
SX Y =0 .0 
SYY=C. 0 
03 ICO KL = 1 f 5 
100 IC ( KL J =0 

03 110 If N 
YSUV=YSUM+YI < Y) 

XSU^=XS'J M +X I (MJ 
110 CONTINUE 

XB= XSUM/N 
Y9=YSUM/N 
03 120 M= If N 
SXX=SXX+( XI ( M ) -X 6 ) * *2 
SYY = SYY+(YI(M)-Y3)**2 
SXY=SXY+( XI (M J-X5) *( YI ( M)-Y9) 

120 CONTINUE 

VRES = (SYY-( (SXY**2 J/SXX I )/ (N-2 ) 

EH= SXY/SXX 

AH = Y8-3H* XB 

SS=(7**2 ) * V R ES 

*=<EH**2 J-SS/SXX 

°=S(2*KK)-Y3 

3=- ( 2*8 H* P) 

C= (o**2)-(SS*(N+1 ) J/N 
F=(BF**2 )*SXX/SS 
SSQ= 1. 0-N*( P* *2 ) / ( S S* ( N+l ) J 
IF (F . L~ . SS C) GO T3 150 
IF ( F . EQ .1 .0 ) G3 TO 50 0 
0=< 2.*XB)-S(K-1) +2. *8H*P/A 
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E=( 2. /A ) * ( ( ( SS*( P**2) /SXX)+ (N+1)*A*$S/N)**.5 ) 

P I L =D-E 
PIR=D+E 
D VAL=S( K+ 1) 

I F ( F .G T . 1.0) ; 0 TC 130 
iC (2 )= IC ( 2 ) +1 

IF ( PVAL . L E . P I R .OR. PVAL.GE.PIL) I C ( 5 ) =IC ( 5 ) + 1 
Go T G 160 

120 IC(1)=ICU)+1 

IF(°IL.LE.PVAL.AND.PIR.GE.PVAL) ICI4)=IC(4)+1 
GO TO 160 

150 iC (3 )=IC(3)+1 
160 01 170 J= 1, 5 

170 IR( J)=I Rt J)+I C( J) 

K = K + 5 

200 CONTINUE 

Cl 220 J = 1 » 5 

220 I PC ( J) =1 PCI J) + IR ( J) 

250 CONTINUE 

C PRINT STATISTICS 

ST AT( IB , 1 ) = R 0 In 
STAT( 18 ,2)=I PC(1) /1CCO.O 
STA*(IB,3) = IPC(2)/1 000.0 
S T AT I I B» 4 ) = IP C ( 3 ) / 1000 .0 
I F ( STAT( IB , 2 ) .EQ.O. C) GO TO 275 
STATI 13 ,5)=I PC (4) /( STAT ( I B, 2 ) * 1 000 . 0 ) 

GO TC 280 

275 ST AT ( IB, 5 )= I°CI 4 ) 

280 IF ( STAT( IB, 3) .EQ. 0.0) GO TO 285 

STAT ( IB »6) =1 PC( 5) /( STAT (I B,3 ) *1 000 .0 ) 

GO TC 290 

285 ST AT ( IB, 6 )= 1^0(5 ) 

290 SI G= STA T( IB ,2 ) *S TA T ( IB , 5) + S TA T ( I B , 3) * STAT ( I B , 6 ) 
1 + STATI IB ,4) 

ST AT ( IB ,7 )=S IG 
RlW=R0W+0 .2 
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300 CONTINUE 

DO 305 IQ = 1 ,5 
CO 305 JQ = 1, 7 

VS (INDEX, 10 , JQ ) = ST4 T( IQ,JQ) 

305 CJNTINUE 

I VS ( INOEX ) =N 
INDE X= INDEX* 1 
I S Z = K-5 

WRITE(6,310) ISZ, -SIGMA, N 
WR ITE ( 6,325) 

WR I TE ( 6,350) { (STA T (K»L) ,L=1 ,7) ,K = 1 ,5) 

310 FORMA - (IX , ' SAMPLE SIZE = ',15,' SIGMA = *,F5.0, ' 

IN = ' , 15, /) 

325 FORMAT! IX,' 10W TYPE 1 TYPE 2 TY C E 3 

1FRCE.1 PRCB.2 CON. P EG ',/,70('-')) 

350 FO R v AT ( 7 ( F3 .3, 2X ) ,/ ) 

WRITE (6, 485) 

GO TO 1 

460 CCR F=0. 1 

IN C EX= INDEX-1 
DO 470 J = 1 , 5 

WRITE (6,472) CORR, SIGMA 
WR I T E (6 ,475 ) 

00 471 1=1, INDEX 

WRI 7E( 6,4 80) ( I VS (I ) , ( VS (I , J ,K) ,K = 2 ,7) ) 

471 CONTINUE 
C0RF=CORR+0 .2 

470 CONTINUE 

472 FORMAT ( • CORR.COEFF. = ' , F5 .3 , • SIGMA = ',F5.0,//j 

475 FORMAT ( ' SAMPLE SIZE T YPE 1 TY °E 2 T Y D E 3 °R 0 

1E.1 DROB. 2 COM. PEG ',/,70('-')) 

480 FORMATd 5 , 5X , 6( F 8. 3 ,2 X) , /) 

500 STOP 
ENC 
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